Algebraic duality of Markov processes
نویسندگان
چکیده
منابع مشابه
Algebraic Markov Decision Processes
In this paper, we provide an algebraic approach to Markov Decision Processes (MDPs), which allows a unified treatment of MDPs and includes many existing models (quantitative or qualitative) as particular cases. In algebraic MDPs, rewards are expressed in a semiring structure, uncertainty is represented by a decomposable plausibility measure valued on a second semiring structure, and preferences...
متن کاملDuality for Labelled Markov Processes
Labelled Markov processes (LMPs) are automata whose transitions are given by probability distributions. In this paper we present a ‘universal’ LMP as the spectrum of a commutative C∗-algebra consisting of formal linear combinations of labelled trees. We characterize the state space of the universal LMP as the set of homomorphims from an ordered commutative monoid of labelled trees into the mult...
متن کاملWorkshop on Duality of Markov Processes
6. and 7. November 2014 Mareike Esser and Sebastian Probst: Duality between the Moran Model with recombination and a marginalised ARG Abstract: Due to the huge state space, it is notoriously difficult to find the full distribution of types in a sample that undergoes recombination. If in addition the recombination rate is large, the usual diffusion limit approach does not apply and computational...
متن کاملA Metrized Duality Theorem for Markov Processes
We extend our previous duality theorem for Markov processes by equipping the processes with a pseudometric and the algebras with a notion of metric diameter. We are able to show that the isomorphisms of our previous duality theorem become isometries in this quantitative setting. This opens the way to developing theories of approximate reasoning for probabilistic systems.
متن کاملOn the notion(s) of duality for Markov processes
Abstract: We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory and give functional analytic results including existence and uniqueness criteria and a comparison of the spectra of dual semi-groups. The analytic fr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Stochastic Processes and their Applications
سال: 1987
ISSN: 0304-4149
DOI: 10.1016/0304-4149(87)90071-8